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TRANSFORMATION STRUCTURES FOR APPROXIMATING 
COLOR MATCHING FUNCTIONS 



The invention relates to methods of color sensing and estimation. More particularly 
the invention relates to techniques for determining RGB filter set and color estimation 
5 performance for RGB LED color sensing. 

In the field of color sensing it is known that any instrument or process used to 
distinguish or sense colors as the human eye does must have spectral responses which 
correspond to some linear transformation of the CIE color mixture 

functions X(A) ,y(JL) , ~z{X) . In color photography this condition is known as the Luther-Ives 
1 0 condition. There are infinitely many real coefficients ai, a 2 and a 3 , such 

thatC(A) = a, x(A) + a 2 y(X) + a 3 z( A), represents an equivalent new color matching function 

C(X). All functions of the C(X) family are equivalent under matrix transformation. 
There is much greater freedom when using color filters for color sensing to 

approximately realize C(X) for a set of coefficients instead of physically realizing the CIE 
15 color matching functions. Since there are infinitely many equivalent C(X)'s, an appropriate 

set of C(A)'s must he determined for a given color filter set 

In order to be approximated by practical color filters, the new transformed color 

matching functions need to satisfy three conditions: 1) C(X) is positive or zero throughout the 

entire spectral range; 2) C(X) has a single peak; 3) the overlaps between the three C(X)'s are 

20 as small as possible. 

One transformation matrix satisfying the above conditions is the well known 

MacAdam's matrix given by: 

f 0.5115 0.5985 -0.11^ 
Mc= -0.5081 1.4093 0.0988 
0 0 1 
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The Mac Adam* s matrix satisfies the conditions for color matching functions that may 
be realized by real filters and is therefore of use in the design of filter sets for specific color 
sensing applications. Custom designed filters sets are particularly expensive to implement, 
especially when the filter must be designed in a specialized shape. For many applications of 
5 color sensing, the custom designed filters necessary for optimal estimation are too expensive. 
It would be desirable to provide a method of utilizing existing low cost filters for sub-optimal 
color sensing to overcome these and other limitations. 

The present invention is directed to a system and method for determining RGB filter 
set and color estimation performance for RGB LED color sensing. Color filter performance 

10 for an RGB LED color sensing system is substantially optimized by detennining 

transformation parameters to optimize spectral approximation. A calibration is provided to 
allow adjustment of parameters. 

In accordance with the invention, a method for determining RGB filter set and color 
estimation performance for RGB LED color sensing is provided. Means for constructing a 

15 criteria function describing an error between desired color matching functions and a spectral 
response of an RGB filter set are provided. Means for determining RGB filter set response 
characteristics based on the criteria function are also provided. Finally, means for 
determining color estimation parameters for substantially optimal color estimation with the 
RGB filter set based upon the determined RGB filter set response characteristics are 

2 0 provided. 

In accordance with another aspect of the invention a computer readable medium 
storing a computer program is provided. Computer readable code for constructing a criteria 
function describing an error between desired color matching functions and a spectral response 
of an RGB filter set is provided. Computer readable code for determining RGB filter set 

2 5 response characteristics based on the criteria function is also provided. Finally, computer 
readable code for determining color estimation parameters for substantially optimal color 
estimation with the RGB filter set based upon the determined RGB filter set response 
characteristics is provided. 

The foregoing and other features and advantages of the invention are apparent from 

30 the following detailed description of exemplary embodiments, read in conjunction with the 
accompanying drawings'. The detailed description and drawings are merely illustrative of the 
invention rather than limiting, the scope of the invention being defined by the appended 
claims and equivalents thereof. 
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FIG. 1 shows the CIE color mixture function arid the MacAdam's color matching 
functions; 

FIG. 2 is a flow diagram illustrating a method for determining RGB filter set and 
color estimation performance for RGB LED color sensing; 
5 FIG. 3 shows a flow diagram illustrating a process for determining color estimation 

parameters for RGB LED color sensing; 

FIG. 4 is a block diagram illustrating an exemplary computer system that may be used 
to implement the method of the invention; and 

FIG. 5 is a block diagram of an exemplary RGB color sensing and estimation system 
10 to which the invention may be applied. 

The present invention is directed to a system and method for determining RGB filter 
set and color estimation performance for RGB LED color sensing. FIG. 1 contains spectral 
response plots of the CIE color matching functions, x(A) 120 , y(A) 130, and z(A) 140, and 
corresponding color matching functions xmc(X) 150 , ymc(Z) 160, and zmc(A) derived 
1 5 from the MacAdam's matrix. Note that the function zmc(A) 9 while present, is not visible on 

FIG.l as z(/t) matches zmc{X) . FIG. 1 is provided for illustration and will be recognized by 
those skilled in the art, 

A criteria function describing an error between desired color matching functions and a 
spectral response of an RGB filter set is constructed. RGB filter set response characteristics 
2 0 based on the criteria function are then determined. Finally, color estimation parameters for 
substantially optimal color estimation with the RGB filter set are determined based upon the 
determined RGB filter set response characteristics. Additional steps not elucidated may 
occur within the following description and some steps may be combined, omitted or occur in 
a different order without departing from the spirit and scope of the invention. 

2 5 FIG. 2 shows a flow diagram illustrating a process for determining RGB filter set and 

color estimation performance for RGB LED color sensing. Process 200 begins in step 210. 
A criteria function describing an error between desired color matching functions and the 
spectral response of an RGB filter set is constructed in step 210. The criteria function is a 
linear vector function bounded over a spectral bandwidth. In general, the criteria function 

3 0 describes the performance of a color sensing or estimation system typically comprised of a set 

of color filters, a set of RGB LED illuminants and a set of color sensors. An advantage of the 
present invention is that the system color filters may be of the low-cost film variety. The 
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criteria function includes a matrix of the spectral responses of red, green and blue LBD's 
respectively, and an unknown constant correction vector "n" that is subtracted from the 
MacAdam's matrix functions and the RGB filter sensitivity functions with an unknown 
constant matrix "M" The criteria function therefore provides a means to determine system 
5 filter performance through evaluation of the unknown constant vectors. If a computer 
implements step 210, a database may be automatically accessed to obtain various data to 
construct the criteria function such as the system RGB LED illuminant spectral data and the 
system filter spectral response data. 

In step 220, RGB filter set response characteristics are determined based on the 

1 0 criteria function. Response characteristics include constant terms for the vector "n" and the 
matrix "M" The criteria function is evaluated to determine values for "Af ' and "n." In one 
embodiment, the criteria function is a constraint set criteria function with a minimum value 
constraint. In the present discussion, the minimum value of the criteria function with 
constraint set and ' V is a color filter performance index for the system RGB LED 

15 illuminants. Therefore, the scalar values of "Af * and *V that result in a minimum value 
criteria function determine the system color filter performance. 

In step, 230 color estimation parameters for substantially optimal color estimation 
with the RGB filter set are determined based upon the system RGB filter set response 
characteristics determined in step 210. Step 230, occurs at any time after the determination of 

2 0 ' V* and "ikf ' in step 220. Step 230 comprises one or more color estimation parameter 
determinations. In one embodiment, color estimation parameters includes structures 
describing localized spectral approximations with weighting functions. In another 
embodiment, color estimation parameters includes structures describing a new set of 
estimated tristimulus values of a white light illuminant formed by an RGB LED set In yet 

2 5 another embodiment, color estimation parameters includes structures describing a color 
calibration for a color estimation system. Substantially optimal color estimation is sub- 
optimal estimation that approaches the ideal of the CIE color mixture functions or a linear 
combination equivalent, while remaining sub-optimal. The color estimation parameters 
determined in step 230 provide inverse transformation structures that allow substantially 
0 optimal color sensing and estimation with low-cost color filters. The criteria function J is 
generally represented by an equation in the form: 
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b(A) 





(1) 



where t(X) 9 g(X) and b(A,) are positive real continuous sensitivity functions of the RGB 

filter set and X e a = [380, 780] nm, R ledW f ^led(^) and CoWare the spectra of red, 
green and blue LED light sources respectively and where 



xmc(X),ymc(X),and zmc(X) m a get of color ma tching functions, and M is a 3x3 constant 
matrix and n is a 3x1 constant vector. 

If a computer implements step 230, a database may be automatically accessed to 
obtain various data to determine color estimation parameters. 
FIG. 3 shows a flow diagram illustrating a process for determining color estimation 
parameters for RGB LED color sensing as in step 230 of FIG. 2. Process 230 begins in step 
340. In step 340, spectral approximation functions x , y , andz for the RGB LED light 
sources are constructed from the "Af " and " determined by evaluating the criteria function. 
The spectral approximation functions include a weighting function. The spectral 
approximation functions are represented by an equation in the form: 



X 




~r(X) 




r(X)- 


y 


= (M 




+ n)*u{M 




z 




b(A) 




b(A) 



+ n}, 



(2) 



where u is a unit step function. 

In step 350, estimated tristimulus values are determined based on the spectral 
functions estimated in step 340. The system color sensors equipped with the system color 
filter set estimate the new tristimulus values based on the white light emission of the system 
RGB LED's. The estimated tristimulus values X , Y , Z are determined according to the 
relationship represented by the equation: 



X 

y 
z 



x(A) 

= j| m 

z(A) 



P(A)dA, 



(3) 



where P(A) = R^A) + G^A) + B^A) . 
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In step 360, a color sensing calibration is implemented. The calibration occurs after 
the determination of tristimulus values in step 360. A calibration matrix is determined and 
applied to correct for error in the system color estimation. The calibration is determined 
according to the relationship represented by the equation: 



X" 




X 
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= M cal Mc~' 


Y 


Z 




Z 



where X, Yand Z are tristimulus functions of the RGB LED illuminants and where 
M ca i is a calibration matrix and Mc l is an inverse MacAdam's matrix. 

FIG. 4 is a block diagram illustrating an exemplary computer system 400 that may be 
used to implement the method of the invention. FIG. 3 shows a computer system 400 
10 containing: an I/O device 410; a processor 420; a user interface 430; memory 440; a display 
450; removable storage 460; a bus 490; and, mass storage 470 containing a database 475, 
programs 476 and an operating system 477. In FIG. 3 the I/O device 410, the processor 420, 
the user interface 430, the memory 440, the display 450, the removable storage 460 and the 
mass storage 470 are all shown coupled to the bus 490. The I/O device 410 is additionally 
1 5 shown enabled for communication external to computer system 400. 

The I/O device 410 is a device capable of bidirectional data communication with a 
device external to the computer system 300. Examples of I/O devices include serial, parallel, 
USB, Ethernet and IEEE 802.1 1 compliant wireless devices, for example. 

The processor 420 is a computing device usually containing memory and data control 
2 0 capability, such as caching and the like. The processor 420 may be integrated with 

supporting hardware such a video controller, a storage device controller and the like. The 
processor 420 generally executes instructions of a computer program such as program 476, 
for example. 

The user interface 430 is a device such as a keyboard, a mouse, a pointing device, a 

2 5 pen, a microphone or another device used to provide a data entry interface with a user of the 

computer system 400. 

The memory 440 is a hardware or virtual storage for computer code and data that the 
processor is manipulating. Memory 440 includes all dynamic memory external to the 
processor including video memory, additional cache memory and the like. Portions of mass 

3 0 storage 470 may also be used to provide virtual memory that may be used interchangeably 

with the memory 440. 



6 



WO 2004/053438 



PCT/IB2003/005651 



The display 450 is a visual display such as a CRT, LCD, plasma or projection display 
used to provide a user with a visual interface with the computer system 400. 

The removable media 460 is any device that provides a removable medium for storing 
computer code or data such as a magnetic disc drive, a writable optical disc drive or the 
5 equivalent 

The mass storage 470 is any device that provides storage for computer code and data 
such as a hard disk drive a recordable optical medium and the like. In one embodiment, the 
mass storage 470 is provided by a second computer server system over a network (not 
shown). The mass storage generally contains the operating system 477, programs 476 and 
1 0 may include a database 475. Programs include applications for execution by the computer 
system 400. 

The bus 490 is a bidirectional communication device that enabled data 
communication between the various devices of computer system 400. The bus may include a 
processor and other logic devices to enable multiple data clock speeds and protocols 
1 5 depending upon the connected devices. 

FIG. 5 is a block diagram of an exemplary RGB color sensing and estimation system 
500 to which the invention may be applied. In FIG. 5 the color sensing system is comprised 
of an RGB LED illuminant 510, a color filter 520 and a color sensor 530. The RGB LED 
illuminant is generally comprised of a trio of a red, green and blue light emitting diodes. The 

2 0 RGB LED's have tristimulus values X, Y and Z respectively. The color filter 520 is 

generally a trio of red, green and blue filters of the polycarbonate film variety and 
equivalents. The color sensor is generally a trio of red, green and blue color sensors. 
Typically, the color filter 520 is attached to the color sensor 530; however, it is not necessary 
for the operation of the color sensing system 500. 
25 An example of the system and method of the invention in operation is now provided. 

However, the following illustration is merely an example of the manner in which the 
invention may be practiced and in no way describes all applications or cites all known 
embodiments of the invention. 

A computer system, such as computer system 400 of FIG. 4, enabled to implement the 

3 0 invention is configured to access a database containing low cost color filter and RGB LED 

data based on the manufacturer and product code and the like. A user provides other data 
concerning the color estimation system components, such as specific RGB LED units and 
color sensor units and the model number of the filter selections. The computer then accesses 
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the filter data and constructs a criteria function. The computer then determines the filter set 
performance and provides values for "n" and "M " The computer then constructs 
approximated spectral response functions based on the determined "n" and "M." The 
computer then calculates estimated new tristimulus values for the approximated spectral 
5 response functions. A color calibration matrix is then determined by the computer based 
upon the estimated tristimulus values and the actual tristimulus values for the system RGB 
LEDs as provided in the computers database. In this manner, a calibrated substantially 
optimal color estimator for an RGB LED illumination system is designed. 

While the preferred embodiments of the invention have been shown and described, 
10 numerous variations and alternative embodiments will occur to those skilled in the art. 

Accordingly, it is intended that the invention be limited only in terms of the appended claims. 
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CLAIMS: 

1 . A method for detennining RGB filter set 520 and color estimation 
performance for RGB LED 510 color sensing 500, the method comprising: 

constructing a criteria function 210 describing an error between desired color 
matching functions and a spectral response of an RGB filter set 520; 

determining RGB filter set 520 response characteristics based on the criteria 
function 220; and 

determining color estimation parameters for substantially optimal color 
estimation with the RGB filter set 520 based upon the determined RGB filter set 520 
response characteristics 230. 

2. The method of claim 1 wherein determining the RGB filter 520 response 
characteristics comprises evaluating the criteria function to determine the RGB filter 520 
response characteristics resulting in a minimum value of a constraint set criteria function. 

3 . The method of claim 2 wherein the criteria function is represented by the 
equation: 
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wherein r(A), g(X) and b(X) are positive real continuous sensitivity functions of the RGB filter 
set 520 wherein Aea= [380, 780] nm and wherein R^X) , G^X) and B LED (X) are the 
spectra of red, green and blue LED light sources 510 and wherein 

xmc{X) t ymc(X),andl zmc{X) are a set of color matching functions and wherein Mis a 3x3 
constant matrix and n is a 3x1 constant vector. 
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4. The method of claim 3 further comprising: 

constructing spectral approximation functions 340 X ,y ,andz for the RGB 
LED light sources 510 ftom the M and n determined by evaluating the criteria function. 



5, The method of claim 4 wherein the spectral approximation functions are 
represented by the equation: 



+ ri) and wherein u is a step function. 
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6. The method of claim 5 further comprising: 

determining estimated tristimulus values 350 for the RGB LED light sources 
510 based upon the spectral approximation functions. 



a a a 



7. The method of claim 6 wherein the estimated tristimulus values X , Y , Z are 
determined according to the relationship represented by the equation: 



P(X)dX wherein P(X) = Ru= D W + GledW + &ledW ■ 
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8. The method of claim 7 further comprising: 

implementing a color sensing color calibration 360 through the function 
represented by the equation: 

wherein X,YandZ are tristimulus functions of the RGB LED 

illuminants 510 and wherein M a/ is a calibration matrix and wherein Mc 1 is an inverse 
MacAdam's matrix. 

9. A computer readable medium 460 storing a computer program 478 
comprising: 

computer readable code for constructing a criteria function 210 describing an 
error between desired color matching functions and a spectral response of an RGB filter set 
520; 

computer readable code for determining RGB filter set 520 response 
characteristics based on the criteria function 220; and 

computer readable code for determining color estimation parameters for 
substantially optimal color estimation with the RGB filter set 520 based upon the determined 
RGB filter set 520 response characteristics 230. 

10. The computer readable medium 460 of claim 9 wherein determining the RGB 
filter 530 response characteristics comprises evaluating the criteria function to determine the 
RGB filter 520 response characteristics resulting in a minimum value of a constraint set 
criteria function. 
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1 1 . The computer readable medium 460 of claim 10 wherein the criteria function 
is represented by the equation: 
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wherein r(X), g(X) and b(X) are positive real continuous sensitivity functions of the RGB filter 
set wherein 2ea= [380, 780] nm and wherein R LED {X) , G LED (X) and B LED (X) are the 
spectra of red, green and blue LED light sources 510 and 



wheremxmc(X) 9 ymc(Z) i and zmc(X) are a set of color matching functions and wherein M 
is a 3x3 constant matrix and n is a 3x1 constant vector. 



12. The computer readable medium 460 of claim 1 1 further comprising: 

computer readable code for constructing spectral approximation functions 
x , y ,andz for the RGB LED light sources 510 from the M and n determined by evaluating 
the criteria function for the RGB filter set 520. 



13. The computer readable medium 460 of claim 12 wherein the spectral 
approximation function equation is: 



+ n) wherein u is a step function. 
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14. The computer readable medium 460 of claim 13 further comprising: 
computer readable code for detennining estimated tristimulus values for the RGB 
LED light sources 510 based upon the spectral approximation functions. 
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1 5 . The computer readable medium 460 of claim 14 wherein the estimated 
tristimulus values X , Y , Z are determined according to the relationship represented by the 
equation: 

X] [x(Z) 

Y =Jy(A) 
Z * 2{Z) 



P(Z)dX wherein P(A) = R L£D (X) + G^X) + B LED (/l) . 



16. The computer readable medium 460 of claim 1 5 further comprising: 

computer readable code for implementing a color sensing color calibration 360 
through the function represented by the equation: 



wherein^ Y and Z are tristimulus functions of the RGB LED 



illuminants 520 and wherein Meal is a calibration matrix and wherein Mc l is an inverse 
MacAdam's matrix. 
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17. A system for determining RGB filter set 520 and color estimation 
performance for RGB LED color sensing 500 comprising: 

means for constructing a criteria function describing an error between desired 
color matching functions and a spectral response of an RGB filter set 520; 

means for determining RGB filter set 520 response characteristics based on 
the criteria function; and 

means for determining color estimation parameters for substantially optimal 
color estimation wilii the RGB filter set 520 based upon the determined RGB filter set 520 
response characteristics. 
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1 8. The system of claim 17 further comprising: 

means for constructing spectral approximation functions x , y ,andz for the 
RGB LED light sources 510 from the M and n determined by evaluating the criteria function. 

19. The system of claim 1 8 further comprising: 

means for determining estimated tristimulus values for the RGB LED light 
sources 510 based upon the spectral approximation functions. 



20. The system of claim 19 further comprising: 

means for implementing a color sensing color calibration through the function 
represented by the equation: 



wherein X, Yand Z are tristimulus functions of the RGB LED 



illuminants 510 and wherein M^i is a calibration matrix and wherein Mc A is an inverse 
MacAdam's matrix. 
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